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THE USE OF AUTOMATIC DATA PROCESSING SYSTEMS 
IN THE RETRIEVAL OF TECHNICAL INFORMATION 


by 


Louis C. Ray 
and 
Russell A. Kirsch 


1, INTRODUCTION 


The National Bureau of Standards and the United States Patent 
Office are actively collaborating in a long-range program to develop 
and apply automatic techniques of information storage and retrieval 
to problems of patent search. An important preliminary phase of 
this program has been the carrying out of experiments with methods 


for locating information in large files of technological and scientific 
information. 


In the granting of United States patents it is necessary for patent 


examiners to refer to collections that may, in principle, contain from 


106 to 107 documents, In effect, when an examiner conducts a litera- 


ture search to determine whether a patent application represents a 
novel idea which then must be tested against established criteria for 
patentability, he must first assure himself, insofar as possible, that 
he has exhaustively searched through all literature in the public domain 
that might possibly contain any information pertinent to the 


cation. It has been estimated that 60 percent of the time sp 
examiner in processing a patent a 


given appli- 
ent by an 
pplication is devoted to searching 

l In an attempt to reduce this expenditure of 
time, the National Bureau of Standards -Patent Office group has con- 


Sidered, among other techniques, the use of automatic data process- 
ing systems. 


the technical literature. 


By an automatic data processing system (ADPS) is meant a 
collection of machines, 


nature, 
with int 


usually but not necessarily electronic in 
which has the ability to process information in accordance 
ernally stored programs and which can perform a whole data 
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All references will be found at the end of the report. 


VU dog ca MU APUL a LO 
NONEM Pre Oe ا‎ 20 ١ : 
ی‎ м HH RE E м E 


ا ار а‏ 


a 

: 

3 
Ho 
em 
ху 


processing task involving the use of data storage facilities of 
diverse natures without the necessity of manual rer VE 
The system also includes devices for the preparation of input 
data and the reproduction of output data. SEAC, the NBS 
Electronic Automatic Computer, is an ADPS and has been used 
in successful preliminary experiments wherein a collection of 
over 200 descriptions of steroid compounds is exhaustively 
searched to answer typical questions that may occur in evalua- 
ting patent applications for new chemical compounds. This 
report describes some theoretical ideas on the use of ADPS 

for literature searching that have -esulted from these experi- 
ments in searching through chemical information. 


In considering any attempt to automatize the searching of 
technical literature in the United States Patent Office, it must 
be remembered that the historical nonautomatic or manual 
method of searching which is presently in effect at the Patent 
Office utilizes the best intellectual efforts of some 800 examiners 
highly trained in diverse technologies and the legal aspects of 
isolating significant information from large technical files. 
sequently, there is no a priori reason to believe that there is 
any single overall solution to the literature s 
the Patent Office which will 
COrps of examiners. 


Con- 


earch problem in 
function as effectively as this trained 
With this consideration in mind, one area 
of the inventive arts was selected for initial ex 
vestigation in the hope that empirical solutions in that area could 
be put into productive operation. A bonus has been the develop- 
ment of theoretical and experimental techniques which should 


Prove applicable to the searching of technical literature in other 
areas of the Patent Office. 


perimental in- 


The area that was selecte 


gation was that of "Compositi 
senerally conce 
chemistry, 
information 


d for initial experimental investi- 

on of Matter, " i, e, ; patents 

rned with what may loosely be classified as 

Chemists have for a long time been concerned with 

retrieval, and it was hoped that use could be made 

7 hiia nds LM that the chemists have developed. As 

á technique 2 obtained took advantage of 
historically, probably not 
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It is of paramount importance to realize that in using auto- 
matic techniques for the retrieval of technical information, no 
more information can be obtained from a file than that informa- 
tion which is represented according to a well-defined consistent 
notational scheme. Because the method of representing chemical 
structures in diagrammatic form has just such properties, it was 
decided to experiment with the use of SEAC for searching through 
files of chemical structure diagrams in response to search re- 
quests fed into the machine. 


I. THE USE OF ADPS FOR SEARCHING CHEMICAL STRUCTURES 


The Structure Search Problem 


In the Patent Office the examiners in the chemical arts have fre- 
quent need for performing so-called generic searches through struc- 
ture diagrams. As an example, it can be seen that the fragment 
structure which is given in Figure 1 is contained in the two compounds 
brucine and codeine shown in Figure 2. Unmarked vertices in the 
structure are understood to represent carbon atoms (C). Notice that 
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j b ing with the nitrogen (N) occurs in codeine even 
the six-mem erf = codeine indicates the ring in a distorted 
though the diagram o that the two compounds in Figure 2 share the 
oe oer x = this fragment. Part of the experi- 
generic deis as SEAC were concerned with developing a method 
eig Wee searches of this type through a file of struc- 
کک‎ the art of steroid chemistry. 


The Structure Search Routine Used on SEAC 
مرو‎ ER CTD 


The Patent Office search requires an unambiguous coding 
system in which any combination of atoms and Donda can bê 
represented for purposes of retrieval. The traditional coding 
systems I are unsuitable for mechanized search because a 
given compound can be represented in conceptually different ways 
or because the system is so complex that it can be used only by a 
trained chemist. Opler 4/ of the Dow Chemical Company has 
developed a code for use in machine searching, This code is 
flexible, but it is unsuitable for Patent Office searches because 
it does not represent the most fundamental units of the chemical 
structure, the atoms and their bonds which are directly required 
in many typical patent searches, 


In the system used on SEAC each atom in a structural diagram 
is numbered serially in arbitrary order. One unit of computer 
storage, called a word, is given to each atom to represent its 
position in the structure. In each word are listed the numbers of 
the other atoms, up to four, that are attached to the atom repre- 
sented by the word. The element symbol and the serial number of 
the atom are also placed in the word. Thus each atom word has six 


fields; the serial number of the atom, four connection fields and an 
element symbol. 


As an illustration, 


l consider the compound, chloral, 
Figure 3, 


; shown in 
The coding would proceed as follows: 
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Figure 3 ۱ Figure 4 


a. First number the atoms and all bonds other than single 
bonds in any arbitrary order as shown in Figure 4. 


b. Then set down a list of the connections to each component of 
the structure, as shown below: 


Component No. Connections 
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c. Finally, put in each word the element symbol of the atom 


it represents as follows: 


Component No. Connections Element Symbol 
1 2 О 
2 1-3 = 
3 2-4-6 C 
4 3 H 
5 6 Cl 
6 3-7-8-5 C 
1 6 1 
8 6 CI 


The list represents the complete code for the structure. The 
structure is easily drawn using the code. The code for any 
structure is not unique since by numbering the atoms in some 
other arbitrary order a different code would be obtained. 1 is 
easily seen however, that all of the possible codes are equivalent. 


It is desired to search a file of coded structures for all struc- 
tures which are identical to some question compound or which have 
some generic property in the sense previously defined. To do this, 
the SEAC search program tries to make an atom-to-atom match 
between the atoms of the question structure and the atoms of the 
first structure recorded in the file. Each match that is made is 
considered as tentative by the program until the search through the 
first file structure is completed. Whenever failure to match is dis- 
covered by the program it tries to go back to the previous match to 
make a new match. If the program finds that all possible first 
matches lead to irreconcilable mismatches, the program will re- 
ject the first file structure and proceed on to the next. When a one- 
to-one correspondence exists between each of the atoms of the 
question and the atoms of part of the file structure that is being 
examined, the routine accepts the structure by printing on the com- 
puter output an indication of which structure was found. The search 


routine continues this process until the whole file has been searched. 


The details of the 


search routine are given in the flow chart in 
Figure 5, 


The symbols used in the chart are defined as follows: 
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I, U, Ш, IV denote the four connection fields in each atom word. 


is a question atom word. 


Qi 


Fb is a file atom word. 


i is a temporary storage location for question atom 
words matched with corresponding file atom words 


(R). 


in Rj is a temporary storage location for file atom words 
matched with corresponding question atom words (N). 


denotes fields of R. It can equall, II, Ill, or IV. 


В denotes fields of N. It can equall, II, III, or IV. 


The Use of Screens for Speeding up the Search 


As fast as a high-speed electronic computer is the fact remains 
that performing a detailed search of the type described would be al- 
together too time-consuming unless some short-cuts could be devised 
which would in no way compromise the exhaustiveness or accuracy of 
the search, while speeding up the process greatly. A technique is needed 
that will enable the ADPS to perform what is for the machine a cursory 
inspection of à small piece of data in such a manner that most structures 
that will not satisfy the search requirement will be rejected immediately. 
Such a technique is called a "screen" or a "screening device.'' It is 
essential that a Screening device should never cause a structure to be 
rejected which does, in fact, meet the search requirement, It is accept- 
able, however, if the screen allows some structures to be considered 
further by the structure search routine even though they are subsequently 
rejected as failing to meet the search requirement. 


By now, p will have become obvious to any chemist that one such 
TT is Еи in the empirical formula of a chemical structure. 
روه‎ MES y Sharing in the file, along with the description of the 
ی‎ e 0 a list of the nomani of occurrences of each type of 
the кы AL the ADPS can inspect this list before it searches 
BAT e out whether there are enough atoms of the right type 

o satisfy the search requirement, This screen was incorporated 


але 


o the SEAC search program and on most searches enabled the 
vast majority of structures that 
a long computational 


int 
computer to reject quickly the 
would otherwise have been rejected only after 


procedure. 


Other screens that were considered but not experimented with 
would make use of topological properties of the chemical structures. 
One such simple screen specifies the number of rings within the 
structure, Obviously, if one were searching for some generic struc- 
ture having, say, three benzene rings, a structure having even 500 


atoms in it could not contain the one being searched for unless there is to 
were at least 3 rings somewhere within the 500-atom structure. more 
codin 
Other topological properties that could serve as screens would Thes: 
be the longest non-self-intersecting path that could be traced through Syste 
the structure and a count of the number of atoms with each of the throu 
possible valences. However, these topological properties were not ment 
experimentally investigated. specii 
ADPS 
The important properties to be sought for in devising screens the sp 
for any type of searching, chemical or otherwise are that the screens when | 
be substantially independent of each other and that they have universal a coll 
applicability to all documents in a collection, These properties are not ge 
never completely achieved in practice, but can be approached when e 
the search is limited to narrowly defined subject matter. The criteria such s 
for evaluating screening devices are, in other words, the same as TO сан 
those used for determining the value of questions in the familiar game tions t 
of "20 Questions," The important difference between the parlor game 
and its ADPS search equivalent is that for the latter all 20 questions ы 
must be completely stated before апу one of them can be answered. mE 
| the ste: 
Grouping of the Information for Searching BE 
though : 
< ee for Pep eee ation of structure diagrams as 
= кыны Ex с : was RECESSES to decide what data about a 
e represented in the code as it was stored in 
the machine file, Certainly an atom -by-atom descripti ld give a ee 
completely general and flexible method f 1 = а $ 
formation, The difficult i à a en, 
ee a 1 y arose in certain of the chemical arts where the The 
one chemical and the next would be very slight in have bee 
the atom -by -atom descri ti 4 imi- Ф. 
ption. On the other hand, very useful discrimi forming ۰ 


nation a i 
mong the members of such a class could be made by including 1P 


а Bos 


the description certain characteristics that were peculiar to 
that particular class. The problem here is one that is un- 
doubtedly a characteristic of systems for coding information 
wherever the information assumes diverse forms; namely, 
how much generality shall be sacrificed in order to provide 
a high degree of discrimination in certain isolated areas of = 
the collection where most of the documents contain similar A 
information. 


A solution to the problem that is practical if ADPS searching 2 
is to be used, but which is probably not practical for use with 
more simple systems (e. g., punched cards) is to have special 
coding systems applicable for certain documents in a collection. — 
These coding systems serve as adjuncts to one (or more) coding 
system which describes the entire collection. If in searching 
through a collection, the screening devices fail to reject a docu- 
ment for which a special coding system is applicable, then | 
special instructions are automatically made available to the De 
ADPS to enable it to search the special document in terms of | 
the special coding system being used. It is quite practicable, 
when searching with an ADPS to have documents scattered through 
a collection that have been described with special coding systems 
not generally used for the whole collection. This technique be- 
comes costly of machine searching time only when the number of 
such special documents is sufficiently large that it becomes 
necessary for the ADPS frequently to call up its auxiliary instruc- 
tions to handle the special coding situation. 


With these considerations in mind, some special coding methods 

suggested by the Patent Office were used for coding structures in 

the steroid chemical art. These coding rules enabled fine distinc- 

tions to be made between various compounds in the steroid art al- 

though the coding rules depended upon certain chemical structure 

properties which were quite peculiar to the steroid art and, there- 

fore, inapplicable for searching other types of chemical structures. 

HI. USE OF ADPS AS PART OF AN INFORMATION RETRIEVAL SYSTEM 
FOR PURPOSES OTHER THAN SEARCHING 


Th j 3 
E E ang theoretical considerations thus far described 
concerned with the use of the ADPS as a tool for actually per- 


forming a sea ile 
8 a search through a file of information (in this case, chemical 
9 - 


9 - 


10 


rieval of information 
This 
data as part of 


ле ۱ ADPS in ret 
i | . However the use of | 
in бакыл ро beyond the activity of actual searc hing. 
Eme s the use of ADPS for processing 


trieval system. 
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an overall information re 


Use of ADPS for Checking Data 


that the file of information through which a search 
d must be prepared without error since any error 

f information represents the loss of some in- 
formation from the file. In the experiments with retrieval of chemi- 
cal structures, the original file was prepared by the Patent Office 
in the form of about 2,500 punched cards that described about 250 
chemical structures. Since one of the features of the coding scheme 
used was its lack of reliance upon chemical knowledge for encoding 
structures, a group of punched card typists were given the set of 250 
pictures describing the structures to be encoded. The operators read 
the pictures and punched the descriptions on cards without the inter- 
vention of any supervision from a chemist, As was to be expected, 
there were some cards out of the 2, 500 that contained errors, and 
the problem was to find the errors and correct them. | 


It is evident 


will be performe 
in a recorded piece o 


Since the data were ultimately to be used as input to SEAC, they 
were first transcribed from punched cards onto magnetic wire (which 
was the principal SEAC input-output medium at the time of the tests 
described). Then a program was written for SEAC to take these data 
from the wire and check them. It is important to note that this data 
cus program was entirely unrelated to the subsequent SEAC 
sea ume : 
5s Se de لو‎ o ees were checked for internal consistency and 
عع‎ qeu то um E rules that had been established. The 
wc rer ou punched card errors and to produce a 
: se parts of the file containing no erro Thi 
iud rors, is expurgated 

en have been used by anothe hi i 
system had been of suitable T сае 
зае е ae вате, other simpler mechanisms could 

8 ough data that had been checked by ADPS. 


Here, then, is an 


> exampl 
information retrieval РР oidhe use of an ADPS as part of an 
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Use of ADPS for Transliteration 
Овео سس‎ 


Another function that an ADPS can serve as part of an information 
| retrieval system is that of transliterating data to be entered into the 
| system from the forms that are most convenient for manual prepara- 
| tion of the data into forms more suitable for searching by machine. In 
the structure search experiment, the data to be used by SEAC had to be 
arranged in a certain format for most efficient utilization of the SEAC 
memory space. This format was sufficiently complicated that the 
punched card operators could not be expected to prepare the data in 5 
that format with any reasonable speed or accuracy. Consequently, a S 
program was written for SEAC which accepted data in a format con- = 
venient for the punched card operators and transliterated the data into 22 
the form desirable for SEAC searching. | 
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Again we have an example of the use of the ADPS, not for searching, 
but in this case for transliterating data from one form into another. It 
should be noted that both the input data for this transliteration program 
and the output produced by the machine followed completely rigorous 
rules of organization and arrangement, The ADPS was converting data 
from one well-defined coded form into another. The fact that this can Eu 
be done readily with an ADPS should not lead one to the conclusion that = 
data expressed in some natural language (e.g., English) can be trans- 
lated by machine into a coded form suitable for machine search, The = 
problem of machine translation is a formidable one to which much ef- = 
fort is being devoted 5/ both in the United States and elsewhere. What 
is claimed here is that the comparatively simple problem of trans- 


literating from one code into another can be conveniently handled by 
an ADPS, 


Another example of transliteration by SEAC which is the subject 

of some current experiments is its use to generate chemical structure 
descriptors for use by a more simple searching machine. It has been 
suggested by Mooers 5/ that for purposes of retrieval, complex struc- 
tures like chemical diagrams can be represented in terms of a list of, 
Say, all the triples of atoms and bonds occurring within the structure. 


Thus, chloral (Figure 3) would be described as consisting of combina- 
tions of the triples listed on the following page. 


uos 


۸ simple search mechanism performing simple comparisons 
between similar types of triples in the search request and the file 
could retrieve complex structures without the necessity of doing 
the complex processing of data of the type performed by the struc- 
ture search routine described earlier, It is not within the Scope 
of this report to discuss the merits of such a search System, How- 
ever, this example is mentioned to demonstrate that an ADPS can 
generate the N-tuple descriptors from a complete representation 
of the structure. If a large file of chemical structures are to be 
retrieved by 2 very simple mechanism using Mooers! N-tuple de- 
Scriptors, the original file may be prepared in, for example, the 
form required for the SEAC structure search routine. It is then 
a fairly straightforward job to program SEAC to generate the N- 
tuple descriptors and consequently to produce as output a trans- 
literated file all prepared for searching by more simple mechanisms. 


Some present SEAC experiments are devoted to generation of the 
N-tuple descriptors from the file of steroid 8 previously 
described. It is intended, then, to run comparative tests on a file 
of chemical structures coded according to the two coding schemes. 
Any results obtained from such a comparison will 


i be less significant, 
however, than the fact that such an experiment demonstrates the 


feasibility of simulating on a large ADPS the searching procedure 


of a more simple mechanism for purposes of comparative evaluation. 


Use of ADPS for Exploring Complex Logical Situations 


In retrieval of information from Patent Office files, it often occurs 
that complex logical conditions must be imposed upon tar the question 
or the tile. A. simple example of the Way in which an ADPS can handle 
pex inter -relationships occurs in the searching of so-called alternativ? 
patent disclosures, EE 


It is quite common for an inventor to describe his invention in 
the following form: A plus B plus any one of the following three, C, 
D, or E, plus any one of the following three, F, G, or H. The ele- 
ments C, D, E are alternatives for each other, as are the elements 
F, G, H, and any one of the first group may possibly be combined 
with any one of the second group for purposes of anticipating a sub- 
sequent patent claim. However, if someone were to claim the combi- 
nation of A+B+C+D the patent described above would not be relevant 
since C and D are disclosed only as alternatives for each other. It 
is desirable to be able to use a search machine that will not accept a 
patent like the first one described when searching for the latter. 


One solution to this problem that has been proposed but does not 
appear practical is to code the alternative type of disclosure separately 
as each of the severaltypes being described. Thus A+Btone of (C, D, E) 
tone of (Е, С, Н) would be represented by 3x3=9 separate entries. In 
many real situations a number in the thousands would describe the 
number of possible combinations claimed in a chemical patent. 


Another method for handling this type of situation on SEAC was 
suggested by the Patent Office and made use of thé structure search 
routine, By the introduction of certain dummy elements into the 
chemical structure, several alternative structures could be coded in 
one large pseudo-structure. If the alternative structure of Figure 6 
18 to be coded, it can be represented as shown in Figure 7 where (X) 
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represents a dummy element. It can be seen that Figure 8 (a) is 
contained in the pseudo-structure of Figure 7, but not Figure 8 (b). 


&)- р 
e 


ас е мер t 


(a) (b) 


Figure 8 


The handling of this complex type of alternative search is possible 
on an ADPS but difficult for à more simple mechanism. In a large in- 
formation retrieval system it may be possible to use more simple mecha- 
nisms than an ADPS for searching until a complex logical situation like 
the alternative search arises, in which case the file may be made avail- 
able to the ADPS for more complete searching. 


There are other complex logical situations that arise in Patent 
Office searching for which it is not yet possible to announce experi- 
menta] solutions, One particularly difficult one occurs when there is 
a reference that is complete except for a minor substitution of some 
component A for the desired component B and when in an entirely separ- 
ate patent there is a statement attesting to the equivalence of A and B 
for the function concerned. It is often desirable to retrieve such a 
partly incomplete reference in conjunction with the reference stating 


equivalence, To date, however, no general solution to this problem is 
known, 


IV. CONCLUSIONS 


Only recently, however, have auto 
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become sufficiently available to be considered as possible tools 

in an information retrieval system. Thus the SEAC experiments 
indicate the practicality of using an ADPS for scanning a file of 
information at high rates. However, many mechanisms consider- 
ably simpler than an ADPS can also do such scanning, and the 
question remains open as to the comparative advantages of an 
ADPS and more simple mechanisms for the actual process of 
looking at a properly organized file. In some retrieval situations, 
most notably in the Patent Office, the problem is of sufficient 
magnitude and complexity that the power of an ADPS to do more 
than just scan a file appears at first inspection to be a requirement, 
Where the ADPS seems to offer a unique contribution is in the off- 
line jobs. For such functions as preparing a search prescription, 
editing a file, eliminating errors, transliterating from one code to 
another, exploring complex logical conditions imposed on the 
question and file, and probably many others, the ADPS offers the 
outstanding virtues of high speed and great versatility. Thus it is 
possible to use SEAC not only to test the utility of an ADPS for the 
Patent Office retrieval problem but also to study the performance 
of other devices by simulating them on SEAC. In the computing 
machine field it is a well-known phenomenon that machine users 
discover many new applications of these machines while in the 
process of using them. It is hoped that the experiments on SEAC 
will serve a similar purpose. 
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THE NATIONAL BUREAU OF STANDARDS 


Functions and Activities 


The functions of the National Bureau of Standards are set forth in the Act of Congress, March 

3. 1901, as amended by Congress in Public Law 619, 1950. These include the development and 
maintenance of the national standards of measurement and the provision of means and methods 
for making measurements consistent with these standards; the determination of physical constants 
and properties of materials; the development of methods and instruments for testing materials, 
devices, and structures; advisory services to Government Agencies on scientific and technical 
problems; invention and development of devices to serve special needs of the Government; and the 
development of standard practices, codes, and specifications. 'The work includes basic and applied. 

research, development, engineering, instrumentation, testing, evaluation, calibration services, and 

various consultation and information services. A major portion of the Bureau's work is performed 

for other Government Agencies, particularly the Department of Defense and the Atomic Energy 


Commission. The scope of activities is suggested by the listing. of divisions and sections on the 


inside of the front cover. 


Reports and Publications 
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The results of the Bureau's work take the form of either actual equipment and devices or 
published papers and reports. Reports are issued to the sponsoring agency of a particular project 
or program. Published papers appear either in the Bureau's own series of publications or in the 
journals of professional and scientific societies. The Bureau itself publishes three monthly peri- 
odicals, available from the Government Printing Office: The Journal of Research, which presents 
complete papers reporting technical investigations: the Technical News Bulletin, which presents 
summary and preliminary reports on work in progress; and Basic Radio Propagation Predictions, 
which provides data for determining the best frequencies to use for radio communications throughout 
the world. "There are also five series of nonperiodical publications: The Applied Mathematics 


Circulars, Handbooks, Building Materials and Structures Reports, and Miscellaneous 
Publications. 


Series, 


Information on the Bureau’s publications can be found in NBS Circular 460, Publications of 


the National Bureau of Standards ($1.25) and its Supplement ($0.75), available from the Superin- 


tendent of Documents, Government Printing Office, Washington 25, D. C. 


Inquiries regarding the Bureau’s reports should be 


addressed to the Office of Technical Informa- 
uon, National Bureau of Standards. Washington SU TET 
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